Teachers' Perceptions of the Impact of the COVID-19 Pandemic and Their Implementation of an Evidence-based HIV Prevention Program in the Bahamas.

Information on how school-based programs is implemented and sustained during crises is limited. In this study, we assessed the impact of the COVID-19 pandemic on the implementation of a HIV prevention intervention in The Bahamas. Data were collected from 139 Grade 6 teachers in 2021-2022. Teachers attended virtual training and received implementation monitoring from coordinators. On average, teachers taught 26.4 (SD = 9.2) of the 35 core activities, and 7.4 (SD = 2.4) out of 9 sessions. More than half (58.3%) of teachers completed 28 or more core activities; 69.1% covered eight or all nine sessions, which is equivalent to 80% of the HIV intervention curriculum. Almost half of the teachers (43%) reported that the pandemic negatively impacted their ability to teach the program; 72% of teachers maintained that the program remained "very important" during times of crisis. Greater self-efficacy and supports increased implementation fidelity.

Effects of Teacher Training and Continued Support on the Delivery of an Evidence-Based HIV Prevention Program: Findings From a National Implementation Study in the Bahamas.

BACKGROUND: Few studies have investigated the effects of teacher training and continued support on teachers' delivery of evidence-based HIV prevention programs. We examined these factors in a national implementation study of an evidence-based HIV risk reduction intervention for adolescents in the sixth grade in the Bahamas. METHODS: Data were collected from 126 grade 6 teachers and 3,118 students in 58 government elementary schools in the Bahamas in 2019-2021. This is a Hybrid Type III implementation study guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) model. Teachers attended 2-day training workshops. Trained school coordinators and peer mentors provided biweekly monitoring and mentorship. We used mixed-effects models to assess the effects of teacher training and continued support on implementation fidelity. RESULTS: Teachers who received training in-person or both in-person and online taught the most core activities (27.0 and 27.2 of 35), versus only online training (21.9) and no training (14.9) (F = 15.27, p < .001). Teachers with an "excellent" or "very good" school coordinator taught more core activities than those with a "satisfactory" coordinator or no coordinator (29.2 vs. 27.8 vs. 19.3 vs. 14.8, F = 29.20, p < .001). Teachers with a "very good" mentor taught more core activities and sessions than those with a "satisfactory" mentor or no mentor (30.4 vs. 25.0 vs. 23.1; F = 7.20; p < .01). Teacher training, implementation monitoring, peer mentoring, teachers' self-efficacy, and school-level support were associated with implementation fidelity, which in turn was associated with improved student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection). CONCLUSION: Teachers receiving in-person training and those having higher-rated school coordinator and mentor support taught a larger number of HIV prevention core activities. Effective teacher training, implementation monitoring, and peer mentoring are critical for improving implementation fidelity and student outcomes.

Implementing a school-based HIV prevention program during public health emergencies: lessons learned in The Bahamas.

BACKGROUND: Natural disasters and public health crises can disrupt communities' capacities to implement important public health programs. A nationwide implementation of an evidence-based HIV prevention program, Focus on Youth in The Caribbean (FOYC) and Caribbean Informed Parents and Children Together (CImPACT), in The Bahamas was disrupted by Hurricane Dorian and the COVID-19 pandemic, especially in its more remote, Family Islands. We explored the teacher- and school-level factors that affected implementation of the program in these islands during those disruptions. METHODS: Data were collected from 47 Grade 6 teachers and 984 students in 34 government elementary schools during the 2020-2021 school year. Teachers completed a pre-implementation questionnaire to record their characteristics and perceptions that might affect their implementation fidelity and an annual program training workshop. School coordinators and high-performing teachers acting as mentors received additional training to provide teachers with monitoring, feedback, and additional support. Teachers submitted data on their completion of the 9 sessions and 35 core activities of FOYC + CImPACT. The fidelity outcomes were the number of sessions and core activities taught by teachers. RESULTS: On average, teachers taught 60% of sessions and 53% of core activities. Teachers with "very good" school coordinators (34% of teachers) taught more activities than those with "satisfactory" (43%) or no (34%) school coordinator (27.5 vs. 16.8 vs. 14.8, F = 12.86, P < 0.001). Teachers who had attended online training or both online and in-person training taught more sessions (6.1 vs. 6.2 vs. 3.6, F = 4.76, P < 0.01) and more core activities (21.1 vs. 20.8 vs. 12.6, F = 3.35, P < 0.05) than those who received no training. Teachers' implementation was associated with improved student outcomes (preventive reproductive health skills, self-efficacy, and intention). CONCLUSIONS: The Hurricane Dorian and the COVID-19 pandemic greatly disrupted education in The Bahamas Family Islands and affected implementation of FOYC + CImPACT. However, we identified several strategies that supported teachers' implementation following these events. Teacher training and implementation monitoring increased implementation fidelity despite external challenges, and students achieved the desired learning outcomes. These strategies can better support teachers' implementation of school-based interventions during future crises.

Comparing standard versus enhanced implementation of an evidence-based HIV prevention program among Bahamian sixth grade students: findings from nationwide implementation trials.

BACKGROUND: Effective implementation strategies are needed to address the challenges encountered by teachers in implementation of evidence-based HV prevention programs in schools. The current study: 1) compares implementation fidelity of Focus on Youth in the Caribbean (FOYC) plus Caribbean Informed Parents and Children Together (CImPACT) intervention using enhanced implementation strategies (including biweekly monitoring/feedback and site-based mentoring) to those using more traditional approach (teacher training only); and 2) evaluates the impact of school coordinators' and mentors' performance on teachers' implementation fidelity and student outcomes. METHODS: Data from an enhanced implementation trial in 2019-2020, involving 24 government primary schools, 79 teachers, and 2252 students, were compared to data from a standard implementation trial in 2011-2012, involving 35 government primary schools, 110 teachers and 2811 students using mixed-effects modeling and structural equation modeling. FINDINGS: Teachers in the 2019-2020 trial taught more core activities (28.3 vs. 16.3, t = 10.80, P < 0.001) and sessions (7.2 vs. 4.4, t = 9.14, P < 0.001) than those participating in the 2011-2012 trial. Teachers taught > 80% of the intervention curriculum in 2019-2020 compared to 50% curriculum delivery in 2011-2012. Teachers who had a "very good" or "excellent" school coordinator in their schools taught more core activities than those who had a "satisfactory" school coordinator (30.4 vs. 29.6 vs. 22.3, F = 18.54, P < 0.001). Teachers who worked in a school which had a "very good" mentor, taught more core activities than those teachers who did not have a mentor or had only a "satisfactory" mentor (30.4 vs. 27.6; t = 2.96; p = 0.004). Teachers' confidence in implementing core activities, comfort level with the curriculum, attitudes towards sex education in schools, and perceived principal support were significantly related to increased self-efficacy, which in turn was related to teachers' implementation fidelity. The degree of implementation was significantly associated with improved student outcomes. IMPLICATIONS/CONCLUSION: An evidence-based HIV prevention intervention can achieve a high degree of implementation when delivered with enhanced implementation strategies and implementation monitoring. Future program implementers should consider the purposeful selection and training of school coordinators and mentors to support low-implementing teachers as a potentially important strategy when attempting to achieve high-quality implementation of school-based interventions.

The Effectiveness of Two Implementation Strategies for Improving Teachers' Delivery of an Evidenced-based HIV Prevention Program.

BACKGROUND: Effective implementation strategies are needed to enhance the success of evidence-based prevention programs. The current study evaluates the effects of two implementation strategies on teachers' implementation of an evidenced-based HIV intervention. METHODS: Using our 7-item pre-implementation school screening tool, we identified teachers who were at-risk for not implementing the Focus on Youth HIV-risk reduction intervention curriculum which targets grade six through grade 8 students. After completing a two-day curriculum workshop, 81 low- and moderate-performing teachers were randomly assigned to one of four experimental conditions and were asked to teach the two-month intervention curriculum. This optimization trial examines the impact of two implementation strategies: biweekly monitoring/feedbacks (BMF) and site-based assistance/mentorship (SAM). The primary outcome is implementation fidelity defined as number of core activities taught. Linear mixed-effects model was used to examine the association of the implementation strategies with implementation fidelity. RESULTS: BMF and SAM were significantly associated with teachers' implementation fidelity. Teachers who received both BFM and SAM taught the greatest numbers of core activities (15 core activities on average), followed by teachers who received either BMF (6.9 activities) or SAM (7.9 activities). Teachers who did not receive BMF or SAM taught the lowest numbers (4.1 activities). Teachers' sustained implementation of FOYC in the prior school year was related to increased implementation fidelity during the optimization trial. Teachers' confidence in implementing five core activities, attitudes toward sex education in schools, and perceived principal support were significantly related to increased self-efficacy, which in turn was related to teachers' fidelity of implementation before the optimization trial. CONCLUSION: BMF and SAM are effective in promoting teachers' implementation of youth evidence-based interventions. Researchers and future program implementers should consider teacher training, teachers' attitudes toward sex education, perceived principal support, and self-efficacy when attempting to maintain the effects of teacher-delivered interventions in schools.

Adolescent HIV-related behavioural prediction using machine learning: a foundation for precision HIV prevention.

BACKGROUND: Precision prevention is increasingly important in HIV prevention research to move beyond universal interventions to those tailored for high-risk individuals. The current study was designed to develop machine learning algorithms for predicting adolescent HIV risk behaviours. METHODS: Comprehensive longitudinal data on adolescent risk behaviours, perceptions, peer and family influence, and neighbourhood risk factors were collected from 2564 grade-10 students at baseline followed for 24 months over 2008-2012. Machine learning techniques [support vector machine (SVM) and random forests] were applied to innovatively leverage longitudinal data for robust HIV risk behaviour prediction. In this study, we focused on two adolescent risk behaviours: had ever had sex and had multiple sex partners. Twenty percent of the data were withheld for model testing. RESULTS: The SVM model with cost-sensitive learning achieved the highest sensitivity, at 79.1%, specificity of 75.4% with AUC of 0.86 in predicting multiple sex partners on the training data (10-fold cross-validation), and sensitivity of 79.7%, specificity of 76.5% with AUC of 0.86 on the testing data. The random forest model obtained the best performance in predicting had ever had sex, yielding the sensitivity of 78.5%, specificity of 73.1% with AUC of 0.84 on the training data and sensitivity of 82.7%, specificity of 75.3% with AUC of 0.87 on the testing data. CONCLUSION: Machine learning methods can be used to build effective prediction model(s) to identify adolescents who are likely to engage in HIV risk behaviours. This study builds a foundation for targeted intervention strategies and informs precision prevention efforts in school-setting.

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention.

BACKGROUND: Intervention effects observed in efficacy trials are rarely replicated when the interventions are broadly disseminated, underscoring the need for more information about factors influencing real-life implementation and program impact. Using data from the ongoing national implementation of an evidence-based HIV prevention program [Focus on Youth in The Caribbean (FOYC)] in The Bahamas, this study examines factors influencing teachers' patterns of implementation, the impact of teachers' initial implementation of FOYC, and subsequent delivery of the booster sessions on students' outcomes. METHODS: Data were collected from the 80 government elementary and 34 middle schools between 2011 and 2014, involving 208 grade 6, 75 grade 7, and 58 grade 8 teachers and 4411 students initially in grade 6 and followed for 3 years. Student outcomes include HIV/AIDS knowledge, reproductive health skills, self-efficacy, and intention to use protection. Data from teachers includes implementation and modification of the curriculum, attitudes towards the prevention program, comfort level with the curriculum, and attendance at training workshops. Structural equation modeling and mixed-effect modeling analyses were applied to examine the impact of teachers' implementation. RESULTS: Teachers' attitudes towards and comfort with the intervention curriculum, and attendance at the curriculum training workshop had a direct effect on teachers' patterns of implementation, which had a direct effect on student outcomes. Teachers' attitudes had a direct positive effect on student outcomes. Teachers' training in interactive teaching methods and longer duration as teachers were positively associated with teachers' comfort with the curriculum. High-quality implementation in grade 6 was significantly related to student outcomes in grades 6 and 7 post-implementation. Level of implementation of the booster sessions in grades 7 and 8 were likewise significantly related to subsequent student outcomes in both grades. CONCLUSIONS: High-quality initial implementation of a prevention program is significantly related to better program outcomes. Poor subsequent delivery of booster sessions can undermine the positive effects from the initial implementation while strong subsequent delivery of booster sessions can partially overcome poor initial implementation.

The Impact of Teachers' Modifications of an Evidenced-Based HIV Prevention Intervention on Program Outcomes.

The degree to which evidence-based program outcomes are affected by modifications is a significant concern in the implementation of interventions. The ongoing national implementation of an evidence-based HIV prevention program targeting grade 6 students in The Bahamas [Focus on Youth in The Caribbean (FOYC)] offers an opportunity to explore factors associated with teachers' modification of FOYC lessons and to examine the impact of types and degrees of modifications on student outcomes. Data were collected in 2012 from 155 teachers and 3646 students in 77 government elementary schools. Results indicate that teachers taught 16 of 30 core activities, 24.5 of 46 total activities and 4.7 of 8 sessions. Over one-half of the teachers made modifications to FOYC core activities; one-fourth of the teachers modified 25 % or more core activities that they taught (heavily modified FOYC). Omitting core activities was the most common content modification, followed by lengthening FOYC lessons with reading, writing assignments or role-play games, and shortening core activities or adding educational videos. Mixed-effects modeling revealed that omitting core activities had negative impacts on all four student outcomes. Shortening core activities and adding videos into lessons had negative impacts on HIV/AIDS knowledge and/or intention to use condom protection. Heavy modifications (>1/4 core activities) were associated with diminished program effectiveness. Heavy modifications and omitting or shortening core activities were negatively related to teachers' level of implementation. We conclude that poorer student outcomes were associated with heavy modifications.

Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program.

BACKGROUND: Teachers' implementation of evidence-based prevention programs in schools is inconsistent. Using data gathered from the national implementation among grade six students in The Bahamas of an evidence-based HIV intervention [Focus on Youth in the Caribbean (FOYC)], this study examines differences in the degree of implementation ("dose") and adherence to the core activities ("fidelity of implementation") by teachers according to theoretically and historically relevant teachers' characteristics, attitudes, and experiences pre-intervention and post-intervention. The relationship of implementation dose and implementation fidelity is assessed according to student outcomes. METHODS: Beginning in 2008, the Bahamian Ministry of Education (MOE) included FOYC in the grade six curriculum nationwide. Consistent with standard practice, teachers were offered MOE training workshops in FOYC prior to delivery. The MOE conducted an anonymous curricular assessment among the grade six students at the beginning and end of the school year. Teachers agreeing to participate in the research component were asked to complete a pre-implementation and post-implementation assessment of attitudes and prior experiences. RESULTS: Teachers taught 15.6 out of 30 core activities, 24 out of the 46 total activities, and 4.6 out of 8 sessions on average. Three teachers' implementation groups were identified: 1) High Implementation Group (31.7% of the teachers), characterized by high levels of implementation dose and fidelity of implementation; 2) Moderate Implementation Group (52.8%), showing moderate levels of implementation dose but high levels of fidelity of implementation; and 3) Low Implementation Group (15.6%), with low levels of implementation dose and fidelity of implementation. Low Implementation Group teachers compared to teachers in the two higher performing groups had less training in interactive teaching, limited prior exposure to the FOYC curriculum, incomplete attendance at FOYC training workshops, and low levels of comfort in teaching FOYC lessons. Students taught by teachers in the Low Implementation Group demonstrated poorer outcomes relevant to the four student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection if they were to have sex). CONCLUSIONS: Both implementation dose and implementation fidelity are related to student outcomes. Teachers at risk for limited implementation can be identified pre-intervention, thus opening the possibility for focused pre-intervention training.

The effects of deprivation on the time spent examining crime scenes and the recovery of DNA and fingerprints.

DNA and fingerprint identifications are now accepted as an integral part of the investigation of a wide range of criminal offences from burglary and auto crime to serious and major crime. Despite this, there is still much variation between U.K. police forces in the recovery of fingerprint and DNA material from crime scenes. Analysis of burglary and auto crime data for Northamptonshire, U.K., during a 3-year period has enabled an examination of the relationship between the deprivation of the neighborhood in which the crime was committed and the level of service provided by Crime Scene Examiners. The results indicate that the time spent examining a crime scene for forensic evidence is not affected by the deprivation of the neighborhood. Further, there is no statistical significance between deprivation and the recovery of fingerprints from the crime scene. The relationship between deprivation and DNA recovery is, however, statistically significant with DNA being recovered more frequently from less deprived neighborhoods.